The last layer cannot be removed.  To clear, choose Select All and choose Clear